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1. INTRODUCTION 

The increase in the urban population in Indonesia increases the complexity of city problems. As a de- 
veloping country, cities in Indonesia face a vast amount of problems, from small-scale and simple issues such 
as trash collection to large-scale and complex problems such as economic development. To solve the various 
city issues effectively, the cooperation between citizens and the government is required [1]. The utilization of 
smartphones in terms of mobile crowdsensing enables such a cooperation where the citizens provide informa- 
tion regarding the city issues, while the government collects and analyzes information to gain insights of the 
various city issues which could then be used for city planning as well as its policies. Figure 1 shows the basic 
crowdsensing system that consists of a crowdsourcer referred to the government and the participants using their 
smartphones to perform the sensing service. Both of them are connected via the cloud. 

To motivate citizens’ participation in crowdsensing and compensate them for their resources, such as 
battery consumption and data transmission costs, it is necessary to incentivize the participants for their sensing 
service. Previous studies have contributed to the development of the incentive mechanism on mobile crowd- 
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sensing, such as the proposed model on the resource-aware incentive mechanism [2], two credit-based privacy- 
aware incentive schemes [3], and the simple endorsement web to incentivize the participants [4]. Nevertheless, 
the challenges to incentivize the crowdsensing participant remain open as discussed in [5]. 

In addition to the challenges to incentivize the participant, another challenge is to optimize crowd- 
sourcer (government) profit in conducting crowdsensing under the limited budget then allocates the budget to 
several regional working units that are responsible for the specific city problems. For instance, the environmen- 
tal working unit is responsible for the environmental problems in the city. To address this issue, we propose the 
multi-objective optimization problem (MOOP) [6] to design an incentive mechanism for mobile crowdsensing 
regarding the city issues. 

To design an incentive model, one can model the interaction between participants and a crowdsourcer 
as a Stackelberg game model. Under this model, the crowdsourcer as the leader moves first and decides its 
strategy; then, the participants as followers pick their best response strategy according to the leader strategy, 
whereas the objective of both the leader and followers is to maximize their utility. There are several studies 
that used the Stackelberg game to model the incentive mechanism [4], [7]-[13]; however, those studies did not 
include a budget constraint for limited budget case. 


By = 


CROWDSOURCER 


PARTICIPANTS 
Figure 1. Mobile crowdsensing system 


2. RELATED WORKS 

There are many studies concerning incentive mechanism design for mobile crowdsensing [14] from 
multi-armed bandit to game theoretical approaches. Gao et al. [15] studied an unknown worker recruitment 
process as a combinatorial multi-armed bandit problem to determine the recruiting strategy that maximizes the 
weighted sum of the completion qualities under a limited budget. Wu et al. [16] proposed a context-aware 
multi-armed bandit incentive mechanism to facilitate quality-based worker selection. Auction games to design 
incentive mechanisms are also widely used. Jin et al. [17] designed an incentive mechanism based on the 
single-minded reverse combinatorial auction to preserve the privacy of the worker’s bid against the other honest- 
but-curious workers. Jin et al. [17] proposed the user-centric model auction-based incentive mechanism which 
is computationally efficient, individually rational, profitable, and truthful. Liu et al. [18] proposed IMRAL, 
i.e., an incentive mechanism based on reverse auction for location-aware sensing, to enhance the willingness of 
users to participate in crowdsensing by maximizing their expected profits. Another game theoretical approach 
used in constructing incentive mechanisms is the Stackelberg game [4], [7]-[13]. 

Previous work by [7] provided an efficient algorithm to compute the unique Stackelberg equilibrium 
at which the crowdsourcer utility is maximized. The extension of this work is provided by [8], [19] to in- 
clude privacy considerations and spatial coverage of the collected dataset. However, the optimization of the 
crowdsoutcer utility in these previous works is less relevant for the case when we want to optimize the profit 
of several regional working units simultaneously. In this case, the notion of multiple crowdsourcers is more 
appropriate. A study by [20] provided an incentive mechanism with multiple crowdsourcers but did not include 
the budget constraint. In addition, all of these studies did not consider the participant reputation. 

Our work on the incentive model is related to the model provided by [7], [8], [19], [20]. We extend 
the existing models by taking the multiple crowdsourcers into account, where each of those represents a certain 
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issue category and thus relates to the regional working unit, and by imposing a budget constraint on the model 
since it is more relevant in real situations. The multiple crowdsourcers case with the budget constraints allows 
us to apply multi-objective optimization [21], [22] by considering multiple crowdsourcer objective functions 
so that we can optimize the profit or utility of each regional working unit simultaneously under a given budget. 


3. SYSTEM MODEL AND PROBLEM FORMULATION 
In this study, we designed an incentive mechanism as follows: 


- It classifies incentives according to issue categories. 

- It considers the participant’s reputation and encourages the participant to report the prioritized issues at a 
certain period. 

- For a given allocated budget, it maximizes the utility of both the participant and the government in each 
category of the issue which corresponds to the regional working unit. 


3.1. System model 

The crowdsensing system consists of N participants and a single crowdsourcer (government) who cat- 
egorized issues into M categories. For instance, there are 17 issue categories as mention in [23] 
Let P = {1,2,--- , N} be the set of participants and C = {c1,c2,--- ,Cm } be the set of issue categories 
where N, M > 2. In this study, we apply a crowdsourcer-centric model [7], [8], [19], [20]. We use Figure 2 to 
represent the system. 


Announce preference issue 


| Send report plan & profile 
TQ 


6 Offer reward to the selected participants 


Send report regarding an issue 


Send reward 


CROWDSOURCER > PARTICIPANTS 


Figure 2. Interaction between participant and crowdsourcer in the incentive model 


The crowdsourcer first announces m prioritized (preference) issues cp E€ C, m > 1. The participant 
i subsequently makes its report plan consisting of the category of issue c; € C that he/she wants to participate 
in and the associated cost per bit of data k; € (0,Kmaz| and then submits it to the crowdsourcer. In this 
case, the participant is free to choose whether he/she wants to report the issue in the prioritized category or 
another issue that he/she encounters. For instance, if the participant wants to report the broken bridge in his/her 
town, he/she can select the infrastructure issue in the set of issue categories. We assume that participants are 
rational and noncooperative, i.e., each participant is only interested in maximizing its utility and if there is not 
a sufficient reward for reporting an issue, he/she will not contribute in crowdsensing. For each participant, the 
crowdsoutrcer knows its profile in terms of its reputation, which is elaborated later. The collection of data (issue 
category, cost, and reputation) provided by each participant enables the system to compute the optimal set of 
participants that maximizes the utility of both the participant and the crowdsourcer. The selected participant 
from the optimal set is then offered some reward for some amount of quality of report q; that he/she is expected 
to submit; otherwise, it would affect his/her reputation. After submitting the data, the selected participant 
receives the payment. In this case, the report quality is determined by the size of the content type of the report, 
such as the breadth of description, in which we might analyze the details of the text description, and the image 
resolution or video frame rate and its resolution, in which we might analyze the field of view from an event in 
a report [24]. 


Incentive mechanism design for citizen reporting application using ... (I Made Ariya Sanjaya) 


2150 g ISSN: 2088-8708 


We apply the Stackelberg game to model the incentive mechanism. In this case, the crowdsourcer is 
a leader and the participants are followers. The crowdsourcer and participants are players of the game. Each 
player has its own strategy. The crowdsourcer’s strategy is the reward for each category of issues, denoted by 
R = (Ra, Reat , Rem ) Whereas the strategy of the participant 7 is the quality of report q; > 0 of an issue 
category that he/she has an interest in participating. The crowdsourcer moves first and decides its strategy in 
terms of reward R. The participants then pick their best response strategy of the quality of the report on a 
certain issue to maximize their own utility. 

We assume that the reward received by participant 2 is proportional to q;, its reputation y;, and the 
parameter associated with the prioritized issue for participant i, denoted by a;. Let V, be the set of participants 
that report the issue on the prioritized category and a € (0, 1); then, a; is defined by 


„ifie V, 
a ana (1) 
0, otherwise 


which provides more reward for the participant who reports the issue on the prioritized category to motivate 
sending the report on the prioritized issue. The reputation of participant i, denoted by 74;, is defined by 


1, for new participant 
Vi = number of approved reports otherwise (2) 
number of selected report plans ’ i 


in which y; E [Ymin, 1] and ymin is the minimum reputation required for a participant to contribute in the 
crowdsensing. We define a new participant as the participant who is just active in crowdsensing for the first 
p times. Suppose p = 4; then, the reputation of the participant is 1 when he/she contributes to crowdsensing 
in the first four times. In this case, the reputation of the new participant is assigned to the maximum value to 
provide the opportunity for a new participant to contribute in the crowdsensing. We assume that in the first 
p times, there is at least one report plan from the new participant to be selected. For other participants, ~y; is 
proportional to the number of approved reports. The approved report is the report that provides a satisfactory 
representation of an event/issue from the analysis of its content. The participant whose report plan is selected 
but does not send the report or its report has a poor representation of the event/issue will gain a lower reputation 
than the participant whose report is approved. 

We refer the utility function of the participant to [7], [8] which assume that the reward is proportional 
to q; and the cost function is linear for participant utility. The utility function (i.e., reward minus cost) of the 
participant 2 interested in reporting an issue on category cj is given by the following (3) 


Poe cena pee (3) 
kev; Vkdk 


where Re, is the reward of issue category cj and V; is the set of participants that report an issue on category 
cj. The utility function of the crowdsourcer for each category of the issue is 


Ue, = AIn (1 DI a!) ah (4) 
i€V; 
with the constraints 
5 (1 + @c;)Re; < Rbudget (5) 
Cj EC 
and 
Re, 2 0 for cj € C (6) 


where A > 1 is a system parameter, y € (0,1) is the rate of the crowdsourcer’s diminishing return on the 
participant’s quality of the report, whereas the In term reflects the crowdsourcer’s diminishing return on the 
number of participants. Ae, = a for the prioritized category; otherwise, it is zero. Rodger is the government 
allocated budget to conduct the crowdsensing. Constraint (5) tells us that the total reward of each issue category 
is at most as much as Rpbuaget in which the term (1+ Qe; ) provides the additional allocation reward for the 
prioritized issues. It is obvious that R<, is nonnegative, as given by constraint (6). 
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3.2. Optimization problem formulation 

The objective of the crowdsourcer is to maximize its utility for each category of the issue for a given 
allocated budget by determining the optimal reward R = (Re, Rez; ++- , Rem ), whereas the participant assigns 
the amount of q; to maximize its utility after committing to report an issue on category cj. The Stackelberg 
game optimization problem can be written as follows: 
- Let A, y, Ac;, and Rbuaget be given. For each category of issue, the crowdsourcer aims to 


nee nal (1 7) =R, l 
maximize Uc; Aln (1+ > q; Re, Ve; E€ C, 
‘ (7) 
subject to 5 (1+ a@c;)Re, < Rouaget: Re; > 0. 

cjEC 


- Let a;, Ki, Rejs Yis Yi, and q_; be given. y_; and q—; are the set of reputation and quality reports other 
than that of participant 7, respectively. For a certain issue category c,;, the participant aims to 


maximize u; = U + a)y: Re, — Kidis 
Gi kev; Vkdk (8) 


subject to q; > 0. 


4. PROBLEM RESOLUTION 

The objective of both the crowdsourcer and the participant leads to the notion of the Stackelberg 
equilibrium, i.e., the equilibrium such that no player can increase its utility by unilaterally changing its strat- 
egy which is associated with the pair of R and q = (q1,q2,--- , qn) that maximizes the utility of both the 
crowdsoutrcer and the participant for a given category of issue. We solve the Stackelberg game problem in the 
previous section by using backward induction where the crowdsourcer considers all possible best responses of 
the participants (if they exist), i.e., the strategy that maximizes each of the participant’s utility on a certain issue 
category regardless of the strategy of other participants; then, the leader chooses its strategy that maximizes its 
utility according to that knowledge. The best response of the participant after choosing a certain issue category 
is its strategy at Nash equilibrium, which is defined as follows: 
Definition 1 For an issue category, a set of strategies q”’® = (q?°,q3°, -+ ,q2°) is a Nash Equilibrium (NE) if 
for any participant 2 in that category 

wigs gS) 2 uladi; a4) 

for any q; > 0. 
q$ denotes the set of quality of reports at NE other than q/’°. In fact, under this model, the strategy at Nash 
equilibrium of a participant 7 that commits to report an issue on category c; exists and is unique [7], [8] which 
is given by (9): 


0, ifi ¢ Sj 
E = ) 0S DaHa Re, 1 DE otherwise @) 
Vi Limes; ae dimes; a ; 
provided by (10), 
Ki _ Limes; Im fori € S; (10) 


% > 181-2 

where S; is the set of participants such that its report plan is selected on issue category c; and |.S;| > 2. 
The algorithm to compute the strategy of the participant at Nash equilibrium is provided in [7], [8]. 
Since we differentiate the participants based on the issue category he/she has chosen, i.e., whether it is a 
prioritized issue or not characterized by a factor a, we take the parameter prioritized category œ; into account 
in the calculation of the report quality at NE given by algorithm 1. By applying (9) in the calculation, the 
report quality at NE of the participants choosing the prioritized issue differs by a factor (1 + a) from those who 
choose the nonprioritized issue category. The crowdsourcer expects a higher report quality for participants who 
are interested in reporting the issue in the prioritized category than those who report the nonprioritized issue. If 
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there is a case in which only one participant sends the report plan to a certain issue category, the crowdsourcer 
might set an arbitrary value of q;, for instance, q; = 1; then, the participant’s utility is (1 + ai)Re; — Ki & 


(1+ ai)Re, given by k; < (1 +. a;)Re, [20]. 


Algorithm 1 Compute the report quality at Nash Equilibrium 


1: Set of issue categories C = {c1,c2,--- , CM} 
2: Set of prioritized categories Cp C C 
3: for each cj € C do 


4: For all participants in issue category cj, set a; = aif cj E€ Cp. Otherwise, set a; = 0. 
5: Sort n participants such that 
BE RBS cen SRE ie Se 
v1 2 Yi F 
6: Select two participants with the lowest a Le., 
i 
S j = {1, 2}. 


Km 
mES; Ym 


T: Sj + Sj U {i} for other participant i < n as long as me < 


[Sj[-1* 
ME : bie (1S;|-1)Q+a;)Re, ()Sj|-1) St ‘ 
8: For each participant i € c;, if i € Sj, then q7?° = 1 = mot = J zi |. Otherwise, q7° = 0. 
Vi U mESj Ym mES; Ym 
9: Obtain the set of report qualities at NE for issue category cj, i.e., (q€, 43°, +++, gre). 


10: end for 


From (9), we know that there is a unique strategy for each participant to maximize its utility. Therefore, 
the crowdsourcer can choose the optimal strategy according to his knowledge about each participant’s best 
response. We might rewrite (4) as (11), 


Ue, = In (1 +R Y T) — R,, for c; €C, (11) 
iESj 


where 


(155| = DU + a4) (, (S-d 


T= 
Km Km 
Vi mes Fim yes: Ym 


In (11) together with (5) and (6) form the multi-objective optimization problem (MOOP). There are 
many methods for solving MOOP including the weighted sum method [25], e-constraint method [26], and 
multi-objective genetic algorithm method [27]. In particular, the weighted sum method is widely used for its 
simplicity. In this study, we use the weighted sum method to solve the crowdsourcer’s utility maximization 
problem. We consider the composite function U as a linear combination of the crowdsourcer’s utility function 
for each issue category given by (12), 


U Se ait, (12) 


cjEC 


where we, is a constant, we, > 0. The weight we, is greater for the prioritized issue categories than for those 
that are not prioritized. We perform function transformation [28] on each crowdsourcer’s utility function so 
that each function has a similar range as (13), 

Ue, 


: (13) 


eat 
KA 
Cj 


t 
Uc, 


where Us, is transformed u,,, and luc, | is the absolute maximum of u,;. The maximum value of uc, exists 
provided by (14), 
Othe: Ay[(1 — y) RY? P + R2- P? 
t= K ) ETT, : <0 (14) 
OR2 (1+ R&P)? 


for Re, > 0, where P = >> 
as Re; > œ. 


y ee : = Si 
ics; T; , which is strictly concave. Moreover, uc, = 0 as Re, = 0 and uc, —> —00 
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Now, the problem for maximizing (11) with the constraint given by (5) and (6) has turned into the 
problem of maximizing the transformed composite function 


U: = 5 We; Ue, (15) 


egEC 


with those constraints. The following theorem provides the Stackelberg equilibrium on the model of the Stack- 
elberg game. 
Theorem 1: Let we, > 0 be given, cj € C. There exists the Stackelberg equilibrium (R*, q”°) on the proposed 
Stackelberg game where R* maximizes the crowdsourcer utility for each issue category. 
Proof 1: For a given category of issue, we have known from the previous discussion that there exists a unique 
strategy set that maximizes each participant’s utility, i.e., the strategy set at Nash equilibrium. Thus, it suffices 
to show that R* exists. The constraints (5) and (6) form a compact and convex set on R“, and U; is contin- 
uous on the constraints which guarantees the existence of R*. In addition, let us consider the second partial 
derivatives of U; as (16) 

OU; We, Ayl(L — y) RUPP + Rey? P?] 


OR, p + REP? 


<0 (16) 


and 
U, 
OR¢, ORe, 
which form a diagonal Hessian matrix with negative entries so that the Hessian matrix is negative definite. 
Hence, U; is strictly concave on its domain. Thus, R* is unique for a given we, > 0 and it is on the Pareto 
front. 


=0 forj #k (17) 


5. SIMULATION RESULTS 

For every number of issue category M, we distinguish the issue categories into two categories, i.e., 
the preference (prioritized) category and nonpreference category. Thus, we might set M = 2 and the set of 
issue categories is given by C = {c 1, cp} in which c; is preference category and c3 is nonpreference category. 

For each category, the number of participants N = 1000. We set parameter A = 10 and y = 0.5 and perform 

several simulations by using the CVXPY solver [29] as follows: 

- Simulation 1: We let ymin = 0.3 and Kmazx = 5 and assume that the reputation and cost for each participant 
is randomly uniformly distributed over [Ymin, 1] and k; € (0,Kmaz]. We then vary preference parameter 
a in the range [0,1] with the increment 0.1. In this case, we solve the trivial optimization problem (not 
MOOP) by considering an issue category. Figure 3 shows the optimal reward at a certain category increases 
as the value of a increases. This occurs because increasing a will increase the first term of (11) so that the 
crowdsourcer utility and the optimal R increase. 


> - on 

o fea] 00 

~ © © 
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Preference parameter 


Figure 3. Optimal reward for different preference parameters 
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- Simulation 2: We let a = 0.4. We use similar distribution as in simulation | for the reputation and cost 
of the participant. We plot the pareto front for different Rbuaget € [3,7] by an increment of 1 with 1000 
data points as shown in Figure 4. Since the budget is limited, the pareto optimal is on X = {R,, Ro € 
R?\(1 + a)Rı + R2 = Rbudget}- 


w 
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Figure 4. Pareto front for different Roudget 


- Simulation 3: We let Roudget = 8 and a = 0.4. The reputation and cost distribution of the participant is 
similar to simulation 1. We vary the weight constant for preference issue category we, in the range [1, 10] 
by an increment of 1, and we set the weight constant for the nonpreference issue category We, = 1. Thus, 
the relative weight = = We,. Figure 5(a) represents the graph of the optimal reward of the preference and 

nonpreference categories of issues for different values of the relative weight. As the relative weight increases, 

the optimal reward of the preference category increases, but the optimal reward of the nonpreference category 
decreases as well as the optimal crowdsourcer utility for each category as shown in Figure 5(b). In this case, 


the budget is more allocated to the prioritized issue as the relative weight increases. 
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Figure 5. The optimal value of (a) reward and (b) crowdsourcer utility of preference and nonpreference issue 
categories for different relative weights 


- Simulation 4: We let Rbuaget be expressed over interval [1, 15] with an increment of 1, a = 0.4, we, = 5, and 
We, = 1. The distribution of reputation and cost of each participant is similar to simulation 1. We examine 
the sum of the report qualities at Nash equilibrium for each category (preference and nonpreference), the 
sum of crowdsourcer utilities, and the sum of optimal rewards of those categories over the range of Roudget 
given by Figure 6(a) to Figure 6(c), respectively. From these figures, we see that after certain Roydget On 
interval 10 to 12, the sum of report qualities reported at NE, the sum of crowdsourcer utilities, and the 
sum of optimal rewards start to increase slowly and are almost constant after Rbudget = 12. The reason is 
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6. 


that after certain Rý, a get» the reward for each issue category attains its optimal value such that the optimal 
reward for cı and the optimal reward for cz, denoted by Rž, and Rz,, respectively, satisfy the condition 
(lo) + Rý, < Rvudget. 


—® nonpreference 54 
—*~ preference 
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(a) (b) (c) 
Figure 6. The sum of (a) report qualities at NE, (b) optimal crowdsourcer utilities, and (c) optimal rewards 
Roudget 


Simulation 5: We let Roudget = 10, a = 0.2, Ymin = 0.5, We, = 5, and We, = 1. We vary Kmaz in the range 
[1,10] with an increment of | and assume that the reputation of each participant is randomly uniformly dis- 
tributed over [Ymin, 1], whereas its cost is uniformly distributed over «k; €  (0,K maz]. 
Figures 7(a) and 7(b) show the sum of report qualities at NE for each category and the sum of crowd- 
sourcer utilities for different Kya, respectively, where these sums decrease as Kmax increases as mentioned 
in [7]. 
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Figure 7. The sum of (a) report qualities at NE and (b) crowdsourcer utilities for different Kmaz 
CONCLUSION 


In this study, we designed an incentive mechanism for mobile crowdsensing based on several iden- 


tified incentive parameters using the Stackelberg game model. We designed the incentive mechanism that 
classified incentives according to the issue categories and motivated participants to report the prioritized is- 
sue. In addition, it considered the participant’s reputation. We used multi-objective optimization to provide 
the maximization of the crowdsourcer utility in each category of the issue which corresponds to the regional 
working unit for a given allocated budget. The simulation indicated that the result appropriately corresponds to 
the theoretical properties of the model. 
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